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Abstract 



We determine the constraints on the anomalous top-quark coupling asso- 
ciated with the flavor-changing neutral current vertex icy from the limits on 
the 6-quark rare decay b — > sj and non-standard top-quark decays. Based on 
these constraints, we discuss the experimental observability of the rare decay 
mode t — ► C7, both at the Fermilab Tevatron with a luminosity-upgrade and 
at the LHC. 



I. INTRODUCTION 

The top quark has been experimentally observed at the Fermilab Tevatron by the CDF 
and DO collaborations Jl| with a measured mass around 175 GeV. Because it has a mass of the 
order of the Fermi scale, the top quark couples quite strongly to the electroweak symmetry- 
breaking sector. In the Standard Model (SM), the electroweak symmetry-breaking sector 
consists of a complex fundamental Higgs scalar, but "triviality" @ and "naturalness" of 
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the scalar sector suggest that the Higgs sector may not be so simple. It is therefore plausible 
to assume that the mass generation mechanism is more complicated and the Higgs sector 
of the SM is just an effective theory, and that new physics phenomena may be manifested 
through effective interactions of the top quark [|[. 

If anomalous top-quark couplings beyond the SM exist, they will affect top-quark pro- 
duction and decay processes at hadron and e + e~ colliders |5|||. Furthermore, such couplings 
would certainly affect certain low-energy quantities which are measured with high precision. 
One such possibility is the partial width ratio Rb = T(Z — > bb)/T(Z — > Hadrons) measured 
at LEP-I, which is about 3a higher than the Standard Model expectation ]7) and could be 
an indication of new physics associated with the heavy top quark. 

In Ref . || , the experimental constraints on an anomalous top-quark coupling Zic and the 
experimental observability of the induced rare decay mode t — > Zc, at the Fermilab Tevatron 
and the LHC at CERN, have been investigated in detail. In this paper, we examine the 
possible anomalous top-quark coupling icy and its implications in both low and high energy 
processes. In our analysis we will also allow for the possibility of a icg coupling because it 
has a similar form to the icy coupling. Since the Standard Model prediction of T(t — > cy) is 
unobservably small || , any experimental evidence for the icy coupling will be an unequivocal 
indication of new physics beyond the Standard Model. 

This paper is organized as follows. In Section II, we examine the constraints on the 
anomalous icy(g) couplings from b — > 57 and from the limit on non-standard top decays 
at the Tevatron. In Section III, we study the possibility of detecting the icy coupling at 
the Tevatron and the LHC, paying particular attention to the kinematical characteristics 
to extract the signal from the possible background. The cuts are adjusted to the different 
physics requirements at the two accelerators. Finally, in Section IV, we summarize our 
results. 
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II. CONSTRAINTS ON THE TOP-QUARK ANOMALOUS COUPLINGS 



Following Ref. [|J, we introduce an effective Lagrangian involving the anomalous top- 
quark couplings, 

C eff = C SM + AC eff (1) 

where C SM is the Standard Model Lagrangian and AC e ^ includes the anomalous top- 
quark couplings. For the purpose of this paper, we consider only the lowest dimension, 
CP-conserving operators which give rise to anomalous icy(g) vertices. Then 

AC eff = j l^eia^cF^ + Kg g s ta^cG l ^\ + h.c. , (2) 

where F^ u is the U em {l) (SU C (3)) field strength tensor; e (g s ) is the corresponding 

coupling constant; and A is the cutoff of the effective theory, which we take to be the order 
of 1 TeV. The parameters n 1 and K g can be interpreted as the strengths of the anomalous 
interactions, or, alternatively, A/k is the approximate scale at which new physics in the 
top-quark sector occurs. 

The measurement of the inclusive branching ratio for the process b — > sj |K| puts 
severe constraints on various extensions of the standard model [[11]. Here we study its 
constraints on anomalous top-quark couplings icy and teg. Anomalous couplings of various 
types associated with the top quark and their constraints obtained from low-energy processes 



have been considered in the literature 12 



The effective Hamiltonian for b — > sy is given by [ p^ , p^| ,|l5|] , 

H eff = -^Gp^V^CiMOiOM), (3) 

where i runs from 1 to 8, and fi denotes the energy scale at which H e ff is applied. The 
operators set Oj(/i) consist of six four-quark operators Oi_6, the electromagnetic dipole 
operator O7, and the chromo-magnetic dipole operator Og. At the weak scale, the only 
contributing operator is O7. However, when evolving down to the low energy scale \i ~ nib, 
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0-j will mix with operator 0$ and others. Here, are the elements of the Cabbibo- 
Kobayashi-Maskawa mixing matrix. 

The partial decay width for b — > 57 is, neglecting the strange-quark mass, 

r(6 - *y) = ^^\V t :V tb C 7 (m b )\ 2 . (4) 

Normalized by the inclusive semileptonic branching ratio, the b — > 57 branching ratio can 
be written as 

BRjb^sj) _ \V; s V tb \ 2 6a 2 

mb^7) ~ \ Vcb \ 2 Mzy r{ b)l ' ( } 

where = 1 — 8z 2 + 8z 6 — — 24z 4 lnz, with 2 = m c /m b . In the standard model, the 
complete leading logarithmic approximation gives [Tj| 



CVK) = v W/23 C 7 (M w ) + V 4 / 23 - r) m / 23 )C 8 (Mw) + C 2 (M W ) £ M p \ (6) 

6 i=i 



with 77 = a s (Mw) / ctsif^b) ■ The coefficients C^M^y), and p J can be found in |T5|. 

The anomalous top-quark couplings icy and teg modify the coefficients of operators 7 
and 0§. The coefficients of these operators at the electroweak scale can be written as 



C 7 (M W ) = C 7 SM (M W ) - M^K, (7) 



C S (M W ) = Cl M {M w ) - -(^) ^ln(— ) % , (8) 

/ Vts A TTI/t 

where C^ M (M W ) and C$ M (M w ) are the standard model contributions. 



Using BR(b — > ceu) = 0.108 and the recent CLEO measurement |]T0 



1 x 10~ 4 < BR(b -> s 7 ) < 4.2 x 10" 4 , 



(9) 



we plot the allowed region for k 7 and n g in Fig. 1, for m b = 5 GeV, m t = 175 GeV, 
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a s (M z ) = 0.12 and \V t * s V tb /V cb \ 2 = 0.95 (TJ. Throughout this paper, we take A = 1 TeV. 
In the figure there are two allowed bands: the right band corresponds to a small anomalous 
correction to the SM C 7 {m b ) coefficient which obeys the limit in Eq. @, while the left band 



corresponds to a large correction which is approximately twice the magnitude of the SM 
contribution but of the opposite sign, so that the magnitude of C 7 (mb) is still consistent 
with Eq. (|). 

A further restriction on k 7 and K g can be obtained from the fact that t —>■ eg and t — *■ cry 
decays are not the most significant top decay modes as shown by the recent CDF data [IB 
A straightforward calculation of partial widths yields 



r(t -> try) 16^2 



(10) 



T(t - m G F (!-^) 2 ( 1 + ^) VA 
where the masses of the c and b quarks have been ignored. For the case of T(t — > eg), a is 
replaced by 4a s /3 in the above equation. 



The CDF data on the branching ratio of top decaying to b [[U| , 

BR(t - bW) = 0.87+°;™ (11) 

places the limit 

BR(t -> eg) < 0.45 (12) 

at the one standard deviation level, where the insignificant contribution of t — > cry has been 
ignored. This constraint gives the limit 

\k 9 \<0.9, (13) 

and is shown in Fig. 1 as the dashed lines. 

One can see that BR(b — > 57) combined with BR{t — ► bW) has constrained « 7 very 
strongly. The branching ratio for t — > cy is shown in Fig. 2(a) versus k 7 for the maximum 
and minimum allowed magnitudes of K g . Specifically, we find that 

for K g = : \Ky\ < 0.16 and BR(t -> 07) < 1.3 x 10 -3 (14) 
for \k 9 \ = 0.9 : |k 7 | < 0.28 and -> 07) < 2.2 x 10~ 3 , (15) 

when accounting for the contribution of the t —>■ eg decay to the total width. A similar 
constraint for the case with K g = has been obtained in Ref. JH]. The branching ratio for 
t — > eg is shown in Fig. 2(b) versus K g . 



III. TOP-QUARK DECAY VIA ANOMALOUS COUPLINGS AT HADRON 

COLLIDERS 



At the Fermilab Tevatron, the cross section for ti production is about 5 pb at y/s = 2 TeV. 
A detailed study of top-quark decays is possible with the expected 1 fb _1 /y r integrated 
luminosity of the Main Injector, or the 10 fb /yr anticipated at the Tevatron Upgrade 
fT8| . Top-quark production is much greater at the LHC, with a cross section being of order 
1000 pb, due to the larger center of mass energy (14 TeV) and higher integrated luminosity 
(100 fb _1 /yr). Therefore it is feasible to search for evidence of anomalous couplings such as 
icy at hadron colliders. 

The decay t — > cy has already been discussed in the previous section. To obtain the 
signal event rate, we calculate the top-quark production via qq, gg — > ti with the lowest 
order matrix elements, but normalize the total cross sections to values which include order 
a? corrections [OK We thus find that the constant K factors are 



K = 1.4 for Tevatron; K = 2.0 for LHC. 

For the parton distributions we use the recent parameterization MRS Set-A [pOR . Due to 
the enormous QCD backgrounds at hadron colliders, it is very difficult, if not impossible, to 
search for the signal if both the top and antitop decay purely hadronically. We therefore look 
for events with one top-quark decay leptonically t — > W + b — > £ + ub (or i — > W~b — > £~ub), 
where £ = e, /x. The cross section for such events is calculated using the exact matrix 
elements for an on-shell W. We have ignored the spin correlations for the decaying top 
quarks since the top-quark production mechanisms we consider give insignificant top-quark 
polarization [fjl . 



Figure 3 shows the calculated total cross section plotted versus k 7 , for two values of 
n g , for the process ti — > bWcy — > jj£ ± ^"j, where £ = e, /z and j represents a jet from 
either a b or c quark. The curves stop at the maximum allowed value of k 7 in each case. 
Figure 3(a) is for the Fermilab Tevatron (pp collisions with ^Js = 2 TeV), and Fig. 3(b) 
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for the LHC (pp collisions with y/s = 14 TeV). We see that for the allowed values of k 7 , 
the signal cross section at the Tevatron could be as large as 4 fb, which is rather small but 
still might be observable at the Tevatron Upgrade. At the LHC, the maximal signal cross 
section is nearly 600 fb, which means that there could be a large number of events even for 
non-maximal couplings. We should remark that the top-quark production cross section is 
somewhat sensitive to the top-quark mass. For m t = 200 GeV, for example, the cross section 
is reduced by slightly more or less than 50% at the Tevatron and the LHC, respectively. 

The only irreducible backgrounds to the signal are electroweak (EW) W ± ^ production 
plus two QCD jets 

pp -> W^jj -> i^vjjj. (16) 

There are also possible "fake" events 

pp -> W ± jjj -> Pwyjj (17) 

where one of the QCD jets fakes a photon. These backgrounds have substantial production 
rates. The signal is however distinctive: besides the isolated charged lepton and large missing 
transverse energy (E™ lss ) from decay, there is a highly energetic photon, and two hard 
(b, c-quark) jets with which cy and bW both reconstruct a top (or t). Without requiring 
6-tagging, our signal selection procedure is as follows: we first examine the two values of 
the invariant mass M(jji) and Mfajz) and identify the jet which gives an M(jj) value 
closer to m t as the c-quark jet. Naturally, the other jet will be identified as 6-quark jet. 
Due to the missing neutrino from the W decay, the W momentum can't be reconstructed 
unambiguously due to the lack of knowledge of the parton cm. frame. This is known as 
the two-fold ambiguity in constructing the neutrino momentum along the beam direction 
||22|| . Taking the W mass as an input and for massless leptons, using the measured charged 
lepton momentum (p e ) and the transverse momentum (with respect to the beam direction) 
of the neutrino (p?) , the two solutions for the longitudinal momentum of the neutrino can 
be expressed by 

7 



't) 2 



1/2' 



(18) 



There are therefore two solutions for p w , correspondingly. We again take the one that 
gives an M(bW) value closer to m t . With this procedure, both top-quark momenta are 
experimentally identifiable. 

To make the calculation more realistic, we simulate the detector effects by assuming a 
Gaussian energy smearing for the electromagnetic and hadronic calorimetry as follows: 



AE/E = 30%/ VE © 1%, for lepton and photon 

= 80%/^ ©5%, for jets, (19) 

where the © indicates that the independent and E'-independent errors are to be added in 
quadrature, and E is to be measured in GeV. 



A. Tevatron 

To quantify the experimental sensitivity to the anomalous couplings, we first impose 
acceptance cuts on the transverse momentum (pr), pseudo-rapidity (rj), and the separation 
in the azimuthal angle-pseudo rapidity plane (Ai2) for the charged lepton and photon from 
the jets. We choose the following "basic" acceptance cuts: 

p l T > 15 GeV, p> T > 20 GeV, p\ > 30 GeV, E™ iss > 20 GeV, 

|?/|, |rf I, \r] j \ < 2.5, AR ej , A%, Ai? 7j > 0.4. (20) 

The high transverse momentum thresholds for the jets and the photon are motivated by 
the hard pt spectrum from the heavy top decay. With these basic cuts, the signal rate 
in Fig. 3(a) is reduced by about 40% (with a maximal value of about 2.7 fb), while the 
EW irreducible background of Eq. ( |IE| ) is about 30 fb, and the QCD process for i^vjjj 
production in Eq. ( |TTD is about 3000 fb. It has been shown that the fake rate for a jet to a 
photon (j — * 7) at the Tevatron experiments can be controlled down to a level of 10~ 4 
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for pj, > 25 GeV, making it insignificant. Therefore, the EW background dominates and we 
will consequently concentrate on that. 

Figure 4(a) shows the reconstructed distributions for the top-antitop invariant mass. 
Obviously, M(tt) for the signal has a kinematical lower limit (2mt if no energy smearing is 
applied); while the lower limit is significantly smaller for the background, near the W^jj 
threshold. If we only accept events with 

M(tt) > 2m t = 350 GeV, (21) 

we expect to improve the signal-to-background ratio (S/B). Also, due to the nature of top- 
quark two-body decay, the final state jets and the photon have transverse momenta typically 
the order of \mt — 80 GeV, while all the jets and photon in the background events tend to 
be soft. To further discriminate the signal from the background, we define two scalar sums 
of the transverse momenta: 

p T (cb) = \ f T \ + \f T \, Pr(clry) = P T (cb) + \pt\. 

Figure 4(b) shows the distributions for these variables. We see indeed that the signal spectra 
are much harder at the low end. On the other hand, they are limited by the physical scale 
2mt for the signal at the high end, while they extend further for the background. With these 
in mind, our choices of the cuts are 

100 < p T (cb) < 300 GeV, 150 < p T (cb-f) < 450GeV. (22) 

With the additional cuts of Eqs. ( j21~|) and (|22|), the EW background is reduced to about 10 
fb, while the signal may be as large as 2.4 fb. 

In Fig. 5 we show the reconstructed top-quark mass distributions M(c~y) and M(bW), 
after making the additional cuts in Eqs. (^) and fl22l) . We see from Fig. 5(a) that, despite 
the improvement in S/B, the continuum background is still above the M(cy) signal peak at 
m t . Further improvement can be made if we only study the events with 

\M(cy) -m t \ < 20 GeV. (23) 
9 



The short-dashed histogram in Fig. 5(b) shows how the background in the M(bW) distri- 
bution is reduced by the cut Eq. fl2"3"|). We find that the signal peak is nearly unaffected by 
this cut and is now above the background, so that statistically significant effects may be 
observed near mt in the M(bW) spectrum. If we examine the events in the mass range 

\M(bW) -m t \ < 30 GeV, (24) 

the signal observability should be nearly optimized. After the cut in Eq. (|24]) we are left 
with a maximal signal of 2.0 fb and an EW background 1.8 fb. 



B. LHC 

At the LHC energy, due to the more complicated hadronic backgrounds, we need to 
increase the transverse momentum thresholds, especially for jets, direct photons and missing 
E T . We adopt the "basic" acceptance cuts as 

V l T > 20 GeV, p> T > 35 GeV, V t > 40 GeV, E^ iss > 30 GeV, 

\rf\, |rf|, < 3, ARtj , A% , Ai? 7j > 0.4. (25) 

The signal rates given in Fig. 3(b) are reduced by about 60% with the cuts of Eq. Q25]) (with 
a maximal value of about 0.22 pb), while the EW background is about 0.5 pb, and the 
"faked" QCD background is about 70 pb. Assuming that we can effectively reject the QCD 
background by photon identification to a level of 10~ 3 for j — ► 7 [pl|, then the dominant 



background is again the electroweak process. We see that after the basic cuts of Eq. ( ]25| ) 
the S/B ratio is much closer to unity than in the Tevatron case. 

Similar to the Tevatron study, we have constructed distributions for the top-antitop 
invariant mass and scalar sums of transverse momenta (see Fig. 6). We see that further 
background suppression can be achieved, without much loss of signal, by the cuts of Eqs. ( |2"T|) 
and (^). The signal integrated cross section after these cuts may be as large as 200 fb, while 
the EW background rate is about 300 fb. 
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As at the Tevatron, reconstructed top-quark mass distributions are also crucial to non- 
ambiguously identify the signal. Figure 7 shows the top-quark mass distributions recon- 
structed from the cy and bW final states after making the cuts in Eqs. ( |21| ) and (^) . Once 
the final cuts in Eqs. fl23|) and ( p4| ) are made, the signal integrated cross section has a 
maximal value of 175 fb and the EW background is 33 fb. We see that the S/B ratio is 
significantly better than at the Tevatron, primarily due to the huge enhancement for the ti 
production at higher cm. energies. 



C. 6-tagging Effects 



The CDF collaboration were able to achieve about 50% 6-tagging efficiency [£5] and one 



hopes to reach about the same efficiency for the LHC experiments [p4| |. The impurity from 



the light quarks/gluons is assumed to be 1%. We therefore can naively expect to further 
suppress the backgrounds by a factor of 1% x rij (where rij is the number of jets) at a cost 
of signal reduction of 50%. 

One has to be cautious in making this statement since there is direct production of 
bb among the other light quark/gluon jets in the background events. We have explicitly 
calculated the W'jbb production rate and found the cross section is about 0.12 fb at the 



Tevatron and 1.1 fb at the LHC with the basic cuts plus Eqs. fl2l|) and (|22|) . This implies 
that the misidentified b from light quarks/gluons is indeed the major background source. 
Consequently, we will not carry out the calculation for the bb fraction in Wjjj events, since 
this channel is always smaller to begin with. 

Table | lists the signal rate (for n g = 0, k 7 = 0.16), EW and QCD backgrounds at the 
Tevatron and the LHC. Comparison is made for the results with only cuts of Eq. (^) for 
Tevatron or Eq. (|25| ) for LHC and Eqs. (pT|)and (f22j), and those plus 6-tagging. We indeed 
obtain significant improvement for the signal/background ratios, although the signal rate at 
the Tevatron is very limited. 



11 



IV. DISCUSSIONS AND SUMMARY 



To estimate the sensitivity to the anomalous couplings for a given accumulated luminos- 
ity, we first establish the approximate cross section formula for the t — > cy case in terms of 
the anomalous couplings: 

K 2 

° = (1 + 1.04^ *("7 = M, = 0) (26) 

where ct(k 7 = l,K g — 0) is calculated for the appropriate set of cuts, and the couplings 
are subject to the constraints in Fig. 1. The cross section ct(k 7 — 1,k 9 — 0) is 80 fb and 
6.8 pb at the Tevatron and LHC, respectively, after the full set of cuts is made. We start 
with Poisson statistics since the signal rate is often small, especially at the Tevatron energy. 
Figure 8 presents the anomalous coupling k 7 versus the luminosity needed to probe « 7 at 
95% Confidence Level (CL).0 The solid curves presented in each panel are for n g = and 
the dashed for \k 9 \ — 0.9. The upper curves for each case are those with kinematical cuts 
only, while the lower ones are that including 6-tagging improvement. We see that at the 
Tevatron energy, minimal luminosity of about 5 fb" 1 is needed in order to probe 
the current low energy constraints at 95% CL. At the LHC with 100 fb -1 , one expects to 
improve the sensitivity to k 7 by more than one order of magnitude. For instance, for n g = 
and with 6-tagging, the sensitivity at the Tevatron reaches 



for 5 fb" 1 : 


k 7 ~ 0.16 


and 


BR{t - 


-> try) 


~ 1.3 x 10" 


10 fb" 1 : 


\k 7 \ ~ 0.12 


and 


BR(t - 


-> try) 


~ 7 x 10" 4 


30 fb" 1 : 


\Ky\ ~ 0.08 


and 


BR(t - 


-> try) 


~ 3 x 10" 4 , 



(27) 



and at the LHC 



x In our approach, a 95% CL in Poisson statistics roughly corresponds to S/y/S + B = 3 in 
Gaussian statistics when the number of events is large. 
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for 10 ftT 1 : |k 7 | ~ 0.02 and BR(t -»• cry) ~ 2 x 10~ 5 

100 fb" 1 : |k 7 | -0.01 and -> 07) ~ 5 x KT 6 , (28) 

Alternatively, setting Kj — 1 and letting A vary (see Eq. (0)), we can view this as a probe 
of the scale of new physics up to A/k 7 ~ 10 TeV at the Tevatron and about 100 TeV at the 
LHC. 

If Kg 7^ 0, there of course is also the possibility of t — > eg decay, which is only mildly 
constrained by current Tevatron data. Although the hadronic nature of the decay might 
make the detection of this mode difficult, the jets resulting from this decay will have large 
transverse momentum, and may allow one to distinguish the signal from the background. 



There is also the possibility of single top production in association with a charm quark p6 
The phenomenology of the teg coupling at hadron colliders is currently under study [E7 . 
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TABLES 

TABLE I. Cross sections in units of fb for the ti — ► i .ubcry signal (k 5 = 0, k 7 = 0.16), and EW 
and QCD backgrounds at the Tevatron and the LHC. Comparison is made for the results with only 
cuts Eqs. (^0|or |25|) and (plj- 22 ) and those plus 6-tagging. 50% tagging efficiency and 1% impurity 



are assumed [25|. 



(a). Tevatron 


signal tt — > i .ubcry 


Wjjj -> e^wyjj 


Wjjj -> i^ujjj 


cuts only 


2.4 


10 


0.66 


plus 6-tag 


1.2 


0.3 


0.01 


(b). LHC 


signal ti — > £ ubcry 


Wjjj -> i^ujjj 


Wjjj -> l^wyjj 


cuts only 


200 


300 


45 


plus 6-tag 


100 


7 


1 
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FIGURE CAPTIONS 

FIG. 1 Constraints on anomalous couplings n g and k 7 from BR(b — > sj) (the two diagonal 
bands in solid lines) and BR(t — > bW) (dashed horizontal lines). A = 1 TeV is assumed 
throughout the paper. 

FIG. 2 (a) Branching ratios for (a) t — > cy versus |« 7 | for \n g \ = (solid line) and 
| K g | = 0.9 (dashed line), and (b) t — > eg versus \k 9 \. The curves stop at the maximum 
allowed value of the abscissa in each case. 

FIG. 3 Production cross section for ti — ► bWc~f — » btvey at (a) the Tevatron (pp) with 
■\/s = 2 TeV, and (b) the LHC (pp) with \fs = 14 TeV. The top-quark mass m t = 175 GeV 
is used throughout the paper. The cross sections are plotted versus |« 7 | for \k 9 \ = (solid 
line) and \k 9 \ — 0.9 (dashed line). The curves stop at the maximum allowed value of |k 7 | in 
each case. 

FIG. 4 (a) Top-antitop invariant mass distributions for the signal ti —>■ Wbcy (solid 
histogram) and background pp — > Wjjj (dashed histogram) at the Tevatron with -y/i = 
2 TeV, assuming the basic acceptance cuts defined in Eq. ( P0| ) in the text, (b) Distributions 
for the transverse momenta scalar sums pribc) and pT{bcy) for the signal (solid histograms) 
and background (dashed histograms). The signal histograms assume the maximal allowed 
value of k 7 with K g = 0. 

FIG. 5 Reconstructed top-quark mass distributions for (a) M(cy) and (b) M(bW) at the 
Tevatron with yfs = 2 TeV. In (a), the solid histogram shows the signal ti — > Wbcy and 
the short dashed histogram shows the background pp — > Wjj'y after applying basic cuts 
and cuts on the top-antitop invariant mass and the transverse momenta scalar sums pr{bc) 
and pT(bcj), while in (b) the same curves are used to show the signal and background after 
making the further cut on M(cy). The long dashed histogram in (b) shows the M(bW) 
distribution of the background before M(cy) cut is made (the effect of the M(cy) cut on 
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the signal is minimal). The signal histograms assume the maximal allowed value of k 7 with 

Kg =0. 

FIG. 6 (a) Top-antitop invariant mass distributions for the signal tt —>■ Wbcy (solid 
histogram) and background pp — > Wjj'-f (dashed histogram) at the LHC with y/s = 14 TeV, 
assuming the basic acceptance cuts defined in Eq. fl25|) in the text, (b) Distributions for the 
transverse momenta scalar sums pxibc) and pxibcy) for the signal (solid histograms) and 
background (dashed histograms). The signal histograms assume the maximal allowed value 
of k 7 with Kg = 0. 

FIG. 7 Reconstructed top-quark mass distributions for (a) M(cy) and (b) M(bW) at 
the LHC with y/s = 14 TeV. In (a), the solid histogram shows the signal tt — > Wbcry and 
the short dashed histogram shows the background pp — > Wjj r y after applying basic cuts 
and cuts on the top-antitop invariant mass and the transverse momenta scalar sums pr{bc) 
and PtQjcj), while in (b) the same curves are used to show the signal and background after 
making the further cut on M{cry). The long dashed histogram in (b) shows the M(bW) 
distribution of the background before M(cy) cut is made (the effect of the M(cy) cut on 
the signal is minimal). The signal histograms assume the maximal allowed value of k 7 with 

Kg = 0. 

FIG. 8 95% CL sensitivity to k 1 vs. integrated luminosity for (a) the Tevatron with 
y/s = 2 TeV and (b) the LHC with y/s = 14 TeV. We consider the limits for K g = (solid 
lines) and \k 9 \ — 0.9 (dashed lines). The upper curves in each case correspond to the limit 
obtained when comparing the signal and background after making all the cuts, while the 
lower curves correspond to the limits obtained when using 6-tagging with the cuts in Eqs. (^ 
or |25|) and (^T]-^2|). The curves cut off at the maximal allowed value of k 7 in each case. 
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